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1. INTRODUCTION 

Techniques for reduciag the bil-rate require- 
ments of digital audio signals have been a concern of 
CCIR* Study Group 10 for many years, and digital 
companding systems based upon NICAM (Near- 
Instantaneous Companding Audio Multiplex)'' and 
A-law are used worldwide to save bit rate in 
numerous applications. With the availability of newer, 
more advanced bit-rate reduction systems, the need 
has arisen for a new CCIR Recommendation to 
identify the most suitable systems and the appropriate 
bit rates to be used in the various broadcasting 
applications. Study Group 10 formed Task Group 
10/2 to conduct such studies as might be necessary, 
and prepare the draft Recommendation. The terms of 
reference for the Task Group are contained in CCIR 
Decision 98*. 

An essential part of the Task Group's work is 
the conduct of listening tests to evaluate the 
performance of different coding systems. Prior to 
conducting such tests, it is necessary to select examples 
of critical programme material to be used in the tests. 

The BBC initially undertook the task of 
selecting the material for the tests of the basic quality 
of codecs for emission, distribution, contribution and 
commentary use, with the help of engineers from other 
organisations participating in the work of the Task 
Group. The BBC also undertook the preparation of 
master recordings of material processed by single 
and cascaded codecs, and the measurement of 



coding/decoding delay and the bit rate exchanged 
between coder and decoder**. Engineers of the TDF 
(Telediffusion de France) prepared source material for 
tests to assess the quality of the stereo perceived by the 
listeners. The subjective tests were duly conducted, and 
coding systems selected for the various areas of 
application*"^ with due consideration being given to 
the complexity of implementation*. 

The members of the Task Group were anxious 
to estabhsh that audio quality would be satisfactory 
after signals had travelled the whole length of a 
broadcasting chain incorporating a number of bit-rate 
reduction processes; so further subjective tests were 
proposed to verify the audio quality at the end of a 
reference model of a complete broadcasting chain, 
including a domestic receiver's decoder. A block 
diagram of the broadcasting chain reference model is 
shown in Fig. 1. Once again, BBC engineers worked 
with colleagues from other participating organisations 
to select critical material and to prepare the recordings 
for the testing centres. 

In the initial work, a total of eight codecs were 
submitted, and these could be configured to operate 
in one or more of the following modes: mono com- 
mentary (speech) coding at 60 kbit/s; joint stereo 
commentary coding at 120 kbit/s; joint stereo emission 
coding at 192 kbit/s; independent stereo emission 
coding at 2 X 128 kbit/s; independent stereo distri- 
bution coding at 2 X 120 kbit/s; independent 
stereo contribution coding. Of the codecs intended for 
contribution use, one, intended for use in accordance 



commentary contribution distribution 


emission 


















code / decode 

128 kbit/s 

per independent 

channel or 

192 kbit/s 

Joint Stereo 








code / decode 

60 kbit/s 

per channel 




code / decode 

180 kbit/s 

per independent 

channel 




code / decode 

120 kbit/s 

per independent 

channel 


• ^ 


h^ 


X 


■ > 
- > 


analogue 










■-^ 






^ 


audio 








5 stages 
< 






3 stages 

< 






D.A.C. 















Note; all connections are EBU/AES unless otherwise stated 
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Comity Consultatit Internationale des Radiocommunications, the International Radio Consultative Committee (part o1 the International 
Telecommunication Union). On 1st March 1993, the CCIR was renamed 'Radiocommunication Bureau'. 

* A.K. McParland and K.J. Taylor assisted with the work described in this Report. 
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with the provisions of CCIR Recommendation 724^ 
operated at a bit rate of 2048 kbit/s. All of the other 
contribution codecs operated at 2 X 180 kbit/s. 

In the subsequent work, with the broadcasting 
chain reference model, only one codec was tested in 
each of the commentary, contribution and distri- 
bution applications. Two stereo emission codecs were 
tested, however, one operating with independent 
coding of the two channels at a bit rate of 128 kbit/s 
per channel (i.e. 256 kbit/s overall) and one 
operating with joint stereo coding at a bit rate of 
192 kbit/s. 



2. DETERMINATION OF THE BIT RATE 
EXCHANGED BETWEEN CODER AND 
DECODER 

As part of the initial work, an indication was 
obtained of the bit rate sent from each coder to its 
decoder. 

A proposal for a standard interface between 
coder and decoder had been made to Task Group 
10/2 by the Fraunhofer Institute for Integrated 
Circuits", with the intention of facilitating the 
determination of the bit rate sent from coder to 
decoder. However, when it came to the point where 
bit rates needed to be measured, none of the codecs 
provided a measurement arrangement which enabled 
the BBC to determine the bit rate with absolute 
certainty and accuracy. Some relied upon the 
introduction of an additional processor unit between 
coder and decoder; others required the duration of a 
burst of data to be measured in terms of the provided 
bit-clock, which was broadly in accordance with the 
Fraunhofer proposal, but without the provision of a 
recognised 'data valid' signal. The elementary 
precaution was taken of verifying that data transitions 
occurred only on one edge of the bit-rate clock. 
However, without constructing special interfaces for 
use with the codecs, the durations of data bursts could 
be determined only approximately. 

Subject to the above reservations, all coders 
were found to be sending data at approximately the 
rate claimed to their respective decoders. 



3. MEASUREMENT OF CODING/ 
DECODING DELAY 

The presence of significant delay in broad- 
casters' connections can adversely affect broadcasting 
operations". It is, in any case, necessary to know the 
delay through the codecs in order to make efficient 
use of the memory on the hard disk of the MPR 



Teltecb workstation (used in the preparation of 
recordings of tandem-connected codecs). It is also 
necessary to know the delay to be able to replay 
recordings of the unprocessed source material and the 
processed material without any difference in timing 
being apparent to the listener*. 

The deby of each codec was measured using 
an Audio Precision 'System One' test set equipped for 
digital-domain measurements. The delay measurement 
uses a maximal-length pseudo-random binary sequence, 
and is intended for determining the reverberation time 
of a room, using a loudspeaker^^. For the measurement 
of coding and decoding delay, the maximal-length 
sequence is applied to the digital input to the coder, 
and the measuring system looks for the correlation 
between the original sequence and the delayed 
sequence obtained at the output of the decoder. The 
test set displays the result of this measurement as a 
confidence reading on the ordinate of a graph, against 
the delay as the abscissa. 

When the test was first applied to the codecs, 
some were found to have a difference in delay 
between the two channels of a stereo pair. The 
providers of the codecs concerned were invited to 
make the modifications necessary to remove the 
differential delay. It was evident, too, that some codecs 
did not always set themselves up with exactly the 
same delay each time they were switched on, or after 
an interruption in the EBU/AES signal at the input. 
In each case, several measurements were made to find 
variations in the delay. 

Many delay measurements were made, and 
stored in the test equipment, but only a few examples 
are presented in this Report. Fig. 2 shows the result 
obtained with the Audio Precision test set output 
connected directly to the input; the measured delay 
was evidently about 10 ixs. At the connection between 
the output and the input of the test set, the pseudo- 
random sequence represented an audio signal level of 
— 10 dB relative to the maximum possible level 
(termed "-10 dBfs" by Audio Precision). Fig. 3 
shows the result obtained vWth the contribution codec 
operating in accordance with CCIR Recommendation 
724®; there is a clear indication that the delay was a 
little less than 3.6 ms. With the codecs operating at 
lower bit rates, exact correlation could not be 
obtained. Nonetheless, all results showed a definite 
peak in the correlation characteristic, corresponding to 
the delay through the codec. The result for one of 
these, an ISO Layer 11 emission codec operating at 
2 X 128 kbit/s, with a delay of about 108.2 ms, is 
shown in Fig. 4. 

* This IS important it an MPR Teltech workstation is being used to 
replay recordings lor individual subjective testing, with switching 
under the control of the listener. 
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Fig. 2 - Result of delay measurement for Audio Precision 
'System One' on its own. 
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Fig. 3 - Result of delay measurement on the 
Recommendation 724 contribution codec. 
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Fig. 4 - Result of delay measurement on the ISO Layer II 
stereo emission coder (operating at 128 kbit/s per channel). 



4. MEASUREMENT OF AMPLITUDE/ 
FREQUENCY RESPONSE 

As part of the initial work, all of the codecs 
were submitted to an amplitude/frequency response 
test, using the swept-frequency tone measurement of 
the Audio Precision 'System One'^'. Measurements 
were made in all conSgurations of each codec, in both 
channels for stereo operation, and at a number of 
different signal levels. Most of the results obtained 
showed that the codecs had a substantially level 
response (most were well within 0.1 dB over the 
whole audio frequency band) typically from about 
20 Hz to about 20 klfe for the emission, distribution 
and contribution codecs, and over a somewhat smaller 
band for the commentary codecs and for codecs 
operating at a sampling frequency of 32 kHz. 

5. CONTRIBUTION SOURCE MATERIAL 

For the tests on contribution codecs, and sub- 
sequently for tests on the reference model of a broad- 
casting chain, it was necessary to create a programme 
of source material having technical characteristics 
similar to those of a digital contribution signal. The 
principal difference between a contribution signal and 
a signal for emission or distribution is that the former 
has margins to ensure that unexpected signal peaks 
will not exceed the coding range of the contribution 
system (causing overioading, or 'clipping') and to 
accommodate subsequent processing of the signal with 
a minimal increase in the levels of quantising error. 
These margins are sometimes termed 'headroom' and 
'processing margin' respectively, and their existence 
implies a coding range in excess of that to be provided 
for distribution and emission. By the time a 
programme reaches the distribution stage in the broad- 
casting chain, the normal processes of level control 
will have reduced the headroom to a minimum, and 
the audio sample words will have been truncated and 
rounded to the distribution/emission standard. 

For the purpose of the contribution codec tests 
for Task Group 10/2, the 16-bit coded signals from 
the DAT recordings of the source material were 
passed through a BBC HDTV digital audio matrix", 
which had been programmed to introduce a 3 dB 
level reduction and output a signal with 24 bits/sample 
resolution. This processing effectively introduced extra 
headroom (of 3 dB) and provided audio samples with 
24 active bits. 



6. SELECTION OF CRITICAL 
PROGRAMME MATERIAL 

The arrangement shown in the block schematic 
of Fig. 5 was used for the selection of critical material 
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Fig. 5 - Arrangement for testing individual codecs with recorded programme material 



in the initial work. Three listeners, from the Swedish 
Broadcasting^ Corporation, the CCETT (Centre 
Commune d'Etudes de Telediffusion et Telecommuni- 
cations) and the BBC, listened to a wide range of 
programme material. This included items which had 
been found critical in earlier listening tests by the three 
organisations, material previously used in Eureka 147 
tests on low bit-rate codecs", material collected for 
the ISO Moving Picture Experts' Group (MPEG) and 
material recommended for consideration by the 
various codec proponents and members of Task 
Group 10/2. Most listening took place using the 
codecs in the emission mode, operating at 192 kbit/s 
(joint stereo) and 2 X 128 kbit/s (independent stereo). 
The source material (comprising 13 programme items, 
listed in Table I) was selected for the tests on 
emission, contribution and distribution codecs. A 
further selection of eight items (some of which had 
already been selected for the emission, contribution 
and distribution codecs) was made for the tests on the 
commentary codecs. The material for commentary 
codec testing is listed in Table 2. 

Once the critical test material had been chosen, 
recordings of the unprocessed source material were 
assembled on digital audio tape (DAT) at 48 kHz 
sampling rate with the aid of a digital audio editor""*. 
For some of the commentary codec tests, mono mixes 
(a summation of left and right channels of the stereo 
material, each attenuated by 6 dB) were required. As 



a precaution against the exploitation of channel-to- 
channel correlation by a mono commentary codec 
providing two channels in 120 kbit/s, the mono mix 
was sent in only one set of the sub-frames of 
EBU/AES interface; a mono mix of 'pop' music at 
a high level occupied the other sub-frames. The 
various mono mixes were made in the BBC six- 
channel HDTV digital audio matrix, which was also 
used to place the mono mixes, as required, in the left 
and right sub-frames of the EBU/AES interface. Fig. 6 
shows the interconnection of the matrix with DAT 
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Table I: Critical material for emission, contribution and distribution codecs. 



Item no. 


Description 




Duration 
(seconds) 


I. 


Asa Jinder: Stilla Skymning, track 5. 


(Eagle Records. CD No, ECD 015) 


25 


2. 


Dire Straits: Ride Across the River, track 6. 


(Warner Bros. CD No. 7599-25264-2) 


28 


3. 


Dalamas Spclmansforbund, directed by Hjort- Anders 
Olsson; Trettondagsmarchen, track 10, 


(Mono Music AB. CD No. MMCD 005) 


27 


4. 


Stefim Nilsson: Speglingar, track 8. 


(Swedish Radio/Pioneer. CD No. PIECD-01) 


24 


5. 


Stravinsky: Wind Octet, track 30. 


(Sony Clasical. CD No. SK 45965) 


24 


6. 


Ravel: 'Feria' from Spanish Suite, track 5. 
Cincinnati Symphony Orchestra. 
EH rector: Jesus Lopez-Cobos. 


(TelarcCD.No.CD-80171) 


30 


7. 


Solo harpischord arpeggio, track 40. 1. 


(EBU SQAM CD. No. 422-204-2) 


9 


8. 


Castanets, track 27. 


(EBU SQAM CD. No. 422-204-2) 


16 


9. 


German male speech, track 54. 


(EBU SQAM CD. No. 422-204-2) 


17 


10. 


Omette Coleman: 'In All Languages', track 7. 


('The Original Quartet and Prime Time', on 
Dreams CD. No. 008) 


19 


11. 


K.B. Enchill: solo base guitar. 


(Swedish National Radio Recording) 


20 


12. 


Suzanne Vega, track 1. 


(A&M CD. No. 395 136-2) 


20 


13. 


Triangles, track 32,1. 


(EBU SQAM CD, No, 422-204-2) 


19 



Table 2: Critical material for commentary codecs. 



Item no. 




Description 


Duration 
(seconds) 


1. 


Asa Jinder: Stilla Skymning, track 5. 


(Eagle Records. CD No. ECD 015) 


25 


2. 


Solo harpischord arpeggio, track 40. 1. 


(EBU SQAM CD. No. 422-204-2) 


9 


3. 


Castanets, track 27. 


(EBU SQAM CD. No. 422-204-2) 


16 


4. 


German male speech, track 54. 


(EBU SQAM CD. No, 422-204-2) 


17 


5. 


Bass clarinet arpeggio, track 17. 


(EBU SQAM CD. No. 422-204-2) 


10 


6. 


Omette Coleman; 'In All Languages', track 7, 


(The Original Quartet and Prime Time', on 
Dreams CD. No, 008) 


19 
19 


7. 


K.B. Enchill: solo base guitar. 


(Swedish National Radio Recording) 


20 


8. 


Sn7anne Vega, track 1. 


(A&M CD. No. 395 136-2) 


20 



recorders and a CD player for preparing the mono 
recordings. 

During the selection of critical material, the 
listeners observed that it was not always the most 
'clean' (i.e. noise-free and distortion-free) material 
which proved to be the most critical. Sometimes 
material which was somewhat imperfect was the most 
effective. The material selected included some imperfect 
items. It was evident, too, that when the same material 
was available both as a Compact Disc and as a DAT 



recording after several generations of digital copying 
(in this case, an ISO MPEG recording) that the DAT 
recording seemed to be a more critical source than the 
original CD. 

In the subsequent work, with the broadcasting 
chain reference model, the arrangement shown in 
Fig. 7 was used for the selection of critical material in 
preliminary listening tests. The original intention was 
to use the HDTV audio matrix to create a simulated 
'contribution' signal by reducing the level of the source 
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Fig. 7 - Arrangement for selecting critical material for testing the broadcasting chain. 



signal by 3 dB (as described in Section 5 of this 
Report) and then to restore the signal level by 
inserting 2.8 dB gain between the contribution decoder 
and distribution coder, and 0.2 dB gain between the 
distribution decoder and the emission coder*. 
However, it proved impossible to restore the original 
signal level, because cHpping occurred on the highest 
signal peaks, and in order to leave adequate margins 
in the system the initial 3 dB reduction in level was 
retained, but the gain between the contribution 
decoder and distribution coder was set to 2.5 dB. A 
further level reduction of 0.2 dB was introduced 
between the distribution decoder and the emission 
coder. Thus the processed signal was at a level 0.7 dB 
lower than the unprocessed source signal during 
preliminary listening. 

The cause of the clipping was not investigated, 
but this may have implications for the design of future 
digital broadcasting networks. 

The decision was made to record all of the 



material subjected to a single pass through the codecs 
at the 'normal' level (i.e. the level obtained by taking 
the signal directly from the Compact Disc player 
via the sampling-frequency converter**) and the 
material processed by the broadcasting chain at the 
'contribution' (-3 dB) level. 

Three listeners, from the Swedish Broadcasting 
Corporation, the IRT (Institut fur Rundfunktechnik) 
and the BBC, hstened to a wide range of programme 
material, includmg items which had been found 
critical in the earher seleaion of critical programme 
material. For the purpose of selecting critical material, 
the hsteners used the arrangement of Fig. 7, with one 
contribution codec, one distribution codec and one 
emission codec. When the final selection was being 
made, the performance of the chain with a 
commentary codec connected prior to the contribution 
codec was taken into account. 

Once the critical test material had been chosen, 
recordings of the unprocessed source material (stereo 



* The reasons for making gam changes at all connections between decoders and the following encoders are explained In the next section ot this 
Report. 

** One of the selected critical test items was from a DAT recording. This was re-recorded via the HDTV audio matrix at a level judged by the 
listeners to be -comfortable- before being played into the broadcasting cham to make the recordmgs. 
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Table 3: Critical material for the broadcasting chain. 



Item no. 




Description 




Duration 
(seconds) 


1. 


Asa Jinder Stilla Skymning, start of track 5. 




(F^igle Records. CD No. ECD 015) 


25 


2. 


Solo harpischord arpeggio, track 40.1. 




(EBU SQAM CD. No. 422-204-2) 


9 


3. 


Solo castanets, track 27. 




(EBU SQAM CD. No. 422-204-2) 


16 


4. 


German male speech, track 54. 




(EBU SQAM CD. No. 422-204-2) 


17 


5. 


Bass clarinet arpeggio, track 1 7. 




(EBU SQAM CD. No. 422-204-2) 


10 


6. 


Bagpipes: 'Amazing Grace'. 




(private DAT recording) 


25 


7. 


Moller, Willemark & Gudmundson: FrifoL, start of 
track 10, 'Vi silde v4ra hemman'. 


(Caprice Records CD No. CAP 21383) 


21 



and mono mixes) were assembled on digital audio 
tape at 48 kHz sampling rate. 

The listeners were required to select between 
four and six critical items. No speech items were 
initially selected, but so that speech would be available 
to the testing centres the most critical speech material 
found was included in the recordings as an extra item. 
The seven critical test items are listed in Table 3. 



7. PREPARATION OF THE RECORDINGS 
FOR SUBJECTIVE TESTS 

Once the source material had been assembled, 
the preparation of master recordings commenced. 
Recordings of signals passed once through a codec 
were made by simply connecting the appropriate 
codec between two DAT recorders (codecs operating 
at a sampling frequency of 32 kHz were connected via 
sampling-frequency converters). 

Recordings of tandem-connected contribution 
and distribution codecs were made using the arrange- 
ment shown in the block schematic diagram of Fig. 8. 
The source material was recorded first of all on the 
hard disk of the MPR Teltech audio workstation". 
The workstation was then connected to each codec 
under test, and programmed to make repeated passes 
of the source material through the codec; five passes 
for contribution codecs and three passes for distribution 
codecs in the initial phase of the work. For the 
subsequent recordings of the broadcasting chain 
reference model, the source signals were processed by 
the contribution codec five times, by the distribution 
codec three times and finally once by an emission 
codec. For some of these recordings, a single pass 
through a commentary codec was performed prior to 
the processing by the contribution, distribution and 
emission codecs. 

Once the program had fmished running, the 
hard disk contained recordings of both the original 



source material and the material processed by the 
maximum number of passes through each codec (but 
no recordings of intermediate numbers of passes). The 
recordings for each configuration of broadcasting chain 
were copied on to DAT and on to 8 mm tape cassette 
upon completion (the 8 mm copies were made via a 
link to a Sun workstation). The MPR Teltech 
workstation operated with a resolution of 24 bits/ 
sample throughout. Any rounding or truncation, to a 
lower resolufion, would have taken place in the codecs 
or at the input to the DAT recorder making the final 
recording. 

In the initial phase of the work, the MPR 
Teltech workstation was programmed to introduce a 
0.1 dB reduction in the audio programme level each 
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Note: 

all connections are EBU/AES unless otherwise stated 

Fig. 8 - Arrangement for making recordings of 
tandem-connected codecs. 
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time it applied a signal to the input of a coder. This 
was dooe to avoid the situation where audio sample 
words might, under some circumstances, be 'mapped' 
between the compressed and linearly-coded domains 
without modification, thereby avoiding the type of 
cumulative impairment which could prove troublesome 
in cascaded connections. The 0.1 dB level reduction 
was chosen because it could re-populate many of the 
quantising levels in a reconstituted linearly-coded 
signal, which might have been removed by bit-rate 
reduction, without itself introducing perceptible changes 
in the nature of the programme signal. The recordings 
provided for the centres testing the cascaded 
distribution and contribution codecs included record- 
ings of the source material which had been reduced in 
level digitally by 0.3 dB and 0.5 dB, respectively (but 
otherwise unprocessed) for use as reference material. 

A recording of source material for stereo image 
tests, prepared by the TDF was used to prepare 
master recordings of emission, contribution and 
distribution codec performance, on the same basis as 
the basic quality test recordings. 

In the second phase of the work, with the 
reference model of the broadcasting chain, an 
attenuation of 0.1 dB was inserted at the connections 
between contribution codecs. Gain of 0.167 dB was 
then used at the connections between the distribution 
codecs and between the last distribution decoder and 
the emission coder. For the tests involving a 
commentary codec prior to the first contribution 
codec, an attenuation of 0. 1 dB was inserted between 
the commentary codec and the first contribution 
codec, and at the connections between the contri- 
bution codecs, with gain of 0.2 dB between the 
distribution codecs and between the last distribution 
decoder and the emission coder. The MPR Teltech 
workstation was programmed to introduce the 0.1 dB 
reductions in the audio programme level at the 
connections between contribution codecs and between 
commentary and contribution codecs. However, it was 
not possible to use the workstation to introduce gain, 
and so the HDTV digital audio matrix was 
programmed to provide the necessary gain, and 
connected between the output of the decoder and the 
input to the AESIC* buffer and distribution ampUGer 
shown in Fig. 8. The HDTV matrix operated with a 
resolution of 24 bits/sample. 

The performance of the broadcasting chain was 
monitored during the preparation of the master 
recordings, and the listeners had some reservations 
concerning the quality obtainable with the reference 
broadcasting chain proposed by Task Group 10/2. 
Because of this, some further recordings were made. 

The AESiC is a BBC integrated circuit used for impiementing 
EBU/AES digital audio interlace inputs, outputs and repeaters'" 



using a broadcasting chain with three contribution 
codecs replacing the three distribution codecs (i.e. with 
chain configurations of eight contribution codecs plus 
an emission codec, and with one commentary codec, 
eight contribution codecs and one emission codec). 



8. CONCLUSIONS 

Critical material has been selected for CCIR 
listening tests on low bit-rate audio codecs, and 
recordings have been made, for use by testing centres. 

A number of significant observations were 
made during the work described in this Report. One 
was that slightly noisy or distorted programme 
material, and multiple-generation DAT recorded 
material, may be impaired more than 'clean' pro- 
gramme material by advanced audio bit-rate reduction 
processes. Another was that clipping of signal peaks 
occurred at signal levels lower than would normally 
have been expected when attempts were made to 
restore signal level in the distribution part of the 
broadcasting chain, after the signal had been attenuated 
for transmission in a contribution codec. Some further 
investigation of these effects might be justified. 

During the preparation of the recordings of 
signals processed by the broadcasting chain, the 
listeners who had selected the critical material were 
concerned that the performance of the reference 
broadcasting chain proposed by Task Group 10/2 
might not be adequate. An alternative configuration of 
the broadcasting chain was therefore devised, and 
recordings made using the same critical test programme 
material with the reconfigured chain. 
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